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(54) External patient contouring 



(57) An open MRI or other diagnostic imaging sys- 
tem (A) generates a three-dimensional diagnostic Im- 
age representation, which is stored in an MRI image 
memory (26). A laser scanner or otlier surface Imaging 
system (B) generates a volumetric surface image rep- 
resentation that is stored in a surface image memory 
(34). Typically, the volume and surface images are mis- 
aligned and the magnetic resonance image may have 
predictable distortions. An image correlating system (C) 



detennines offset, scaling, rotational, and non-linear 
corrections to the magnetic resonance image represen- 
tation, which are implemented by an image correction 
processor (48). The con'ected magnetic resonance im- 
age representation and the surface image representa- 
tion are combined (50) and stored In a superimposed 
image memory (52). A video processor (54) generates 
image representations from selected portions of the su- 
perimposed image representation for display on a hu- 
man-readable monitor (56). 
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Description 

[0001 1 The present invention relates to the field of im- 
aging. It finds particular application in conjunction with 
diagnostic imaging In open MRI scanners for oncology 
treatment applications and will be described with partic- 
ular reference thereto. It will be appreciated, however, 
that the Invention Is also applicable to other types of di- 
agnostic imaging for oncological purposes and for im- 
aging for other purposes. 

[0002] In oncological planning, the oncologist typical- 
ly determines a point of entry on the patient's skin and 
a trajectory through the patient. Typically, the oncologist 
plans a trajectory and the point of entry In conjunction 
with projection x-ray images, CT scanner images, or 
other diagnostic images. 

[0003] One of the difficulties encountered in oncolog- 
ical procedures is accurately aligning the x-ray beam 
with the Internal tumor. If the selected trajectory Is only 
slightly off, the x-ray beam will treat most of the tumor, 
but leave a small segment un-lradiated. Un-lrradiated 
tumor tissue can survive the treatment. 
[0004] O nee the point of entry and the trajectory have 
been detemnined. the oncologist points an x-ray beam 
to enter the patient at the selected point of entry and 
follow the selected trajectory. Ideally, the x-ray beam is 
selected to have a diameter at least as large as the tu- 
mor to be Irradiated. Making the diameter of the beam 
too large Is detrimental In that it in-adiates and harms 
healthy tissue. 

[0005] Typically, the treatment process Is repeated 
through a plurality of different trajectories to maximize 
the radiation at the tumor while minimizing radiation 
through surrounding tissue. In many Instances, the tu- 
mor is over-irradiated to assure that portions of the tu- 
mor which might be missed along some trajectories are 
still fully irradiated. This over-radiation, like using a 
beam that is too large, has a detiimental effect on sur- 
rounding tissue. 

[0008] Typically, x-ray images are used to generate 
the diagnostic images. X-ray images are advantageous 
In that they image the entire patient contour, including 
the surface boundaries facilitating selection of the point 
of entry. Unfortunately, It is sometimes difficult to differ- 
entiate between tissue types, such as cancerous and 
non-cancerous tissue with x-rays. Magnetic resonance 
imaging has much better differentiation of tissue types. 
However, magnetic resonance images tend to be of 
smaller, internal regions and often do not Include the pa- 
tient surface. When a larger region is imaged that In- 
cludes the patient surface, peripheral portions of the Im- 
age tend to be warped or distorted. Selecting the point 
of entry based on a warped or distorted image can cause 
mis-alignment between the beam and the cancerous tu- 
mor which, as discussed previously, can create the un- 
wanted destruction of healthy tissue. 
[0007] In accordance with one aspect of the present 
Invention, a diagnostto imaging system is provided. A 



medical diagnostic imaging apparatus generates volu- 
metric diagnostic image representations of an internal 
region of a subject In an imaging region. A surface im- 
aging system generates a three-dimensional image rep- 

5 resentation of the surface of the subject in tiie imaging 
region. An image correlating system conrelates the sur- 
face and diagnostks image representations. A superim- 
posed volumetric image representation memory stores 
combined correlated surface and diagnostic image rep- 

10 resentations. A video processor withdraws selected por- 
tions of the combined image representation and con- 
verts tiiem into appropriate form for human-readable 
display. 

[0008] In accordance with another aspect of the 

IS present invention, a method of diagnostic Imaging is 
provided. A volumetric diagnostic image representation 
of an Intemal region of a subject and at least a portion 
of a surface of the subject is generated. However, the 
diagnostic image representation has distortions, partic- 

20 ulariy in a region adjacent the surface of the subject. A 
surface imaging system generates a tiiree-dlmensional 
image representation of the surface of the subject. The 
diagnostic image representation is adjusted to conflate 
at least the surface region of the diagnostic image rep- 

25 resentation with the surface image representation. The 
adjusted diagnostte image representation and the sur- 
face Image representation are combined. 
[0009] One advantage of the present invention is that 
It pennlts Improved differentiation of soft tissue. 

30 [0010] Another advantage of the present Invention is 
that It facilitates a reduction in radiation doses In onco- 
logical treatments. 

[0011] Another advantage of the present invention is 
that it facilitates location of intemal patient structures 
35 from the exterior of the patient based on diagnostic im- 
ages. 

[0012] Another advantage of the present Invention Is 
that it reduces total patient radiation dose relative to x- 
ray and CT diagnostic imaging techniques. 

40 [001 3] One way of canying out the invention will now 
be described In detail, by way of example, with reference 
to the accompanying drawing (Figure 1), which is a di- 
agrammatic illustration of an Image generation system 
In accordance with the present invention. 

45 [0014] With reference to FIGURE 1 . a medical diag- 
nostic imaging apparatus A, such as an open magnetic 
resonance imaging system, generates a volumetric Im- 
age of an internal region of the patient including a portion 
of the patient surface. A surface imaging system B gen- 

50 erates a volumetric Image of the patient surface. An im- 
aging con-eiating system C scales, shifts, rotates, and 
non-llneariy adjusts the medteal diagnostic Image to 
bring it into correlation with the surface Image represen- 
tation. The coaelated Images are combined to provide 

55 a combined or superimposed image of interior and sur- 
face from which the oncologist extracts medically appro- 
priate sik:e, 3D rendered, or other images for planning 
the oncologtoal procedure. 
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[0015] The diagnostic imager A in the preferred enn- 
bodiment is a vertical field magnetic resonance imaging 
system that includes an upper pole 10 and a lower pole 
12. Magnets, preferably superconducting, generate a 
vertical magnetic field through an imaging region 1 4 be- 5 
tween the poles 10 and 1 2. A patient support 1 6 is mov- 
able in three dimensions to position a region of interest 
of a subject 18 in the imaging region. 
[001 6] A sequence control processor 20 controls gra- 
dient and radio frequency coils associated with the poles io 
10, 12 of the magnetic resonance imager to induce and 
manipulate magnetic resonance, as is known in the art. 
to generate magnetic resonance signals. The generated 
magnetic resonance signals are picked by radio fre- 
quency coils, demodulated by a receiver 22, and recon- i5 
structed by an MRI image reconstruction processor 24 
Into an electronic image representation. The electronic 
image representation of the region of interest of the sub- 
ject disposed in the imaging region 14 Is stored in an 
M Rl volume image memory 26. 20 
[001 71 The surface imaging system B in the preferred 
embodiment Is a hand-held laser scanning system. 
More specifically, the laser scanning system includes a 
hand-heid unit 30 which sweeps a laser beam. The 
hand-held unit 30 Is positioned such that the laser beam 25 
scans the surface of the subject 18 in the imaging region 
14. The reflected laser light received by the hand-held 
unit 30 generates electronic signals which are conveyed 
to a surface image reconstruction processor 32 which 
reconstructs an electronic image representation of the 30 
surface of the subject 18 in three dimensions. A surface 
volume Image memory 34 stores the electronic Image 
representation. Other known surface imaging systems 
are also contemplated, such as ultrasonic imaging sys- 
tems, optical imaging systems such as those with stereo 35 
cameras, mechanteal anms which are moved over the 
surface, and the like. 

[001 8] In order to facilitate coordination of the surface 
and MRI diagnostic images, a plurality of fiduclals 40 
that are imageable by both the MRI imaging system and 40 
the surface imaging system, are preferably adhered to 
several, scattered positions on the surface of the patient 
in the examination region. Alternately, anatomical mark- 
ers that are identifiable In both images can be utilized 
analogously. The image correlating system C includes 45 
a fiducial locating processor 42 which examines the 
electronic surface and diagnostic image representa- 
tions to identify the fiducials 40 in each. More specifical- 
ly, the fiducial locating processor 42 generates a three- 
dimensional image representation of the fiduclals 40 in so 
the diagnostic image. An alignment processor 44 com- 
pares the position of the fiducials in the two images. In 
one embodiment, the alignment processor 44 deter- 
mines the baricenter of the fiducials 40 in each of the 
aforementioned images and determines an offset or lin- S5 
ear shift therebetween. The alignment processor also 
determines the distance between the baricenter and 
each of the fiducials 40 in each of the aforementioned 



images and determines a scaling factor in accordance 
with the variation therebetween. The alignment proces- 
sor 44 also determines rays between the baricenter and 
the fiduclals 40 In each of the aforementioned images 
and determines an angular offset or rotational correction 
between the two. Preferably, the alignment processor 
44 also accesses a reference image from a reference 
image memory 46 to perform higher order alignment 
functions. More specifk:ally to the preferred embodi- 
ment, an image of a phantom Is generated with the med- 
ical diagnostk; imaging apparatus A. Based on differ- 
ences between the known shape of the phantom and 
the shape of the Image, non-linear distortion adjust- 
ments for the diagnostic Imaging apparatus A are gen- 
erated and stored In the reference Image memory 46. 
[0019] The offset, scaling, rotational, and non-linear 
image corrections determined by the alignment proces- 
sor 44 are conveyed to an image connection processor 
48 which operates on the medical diagnostk; Image rep- 
resentation to bring it Into alignment with the surface im- 
age representation. 

[0020] The surface and corrected diagnostic image 
representations are combined 50 and stored in a super- 
imposed volumetric image memory 52. Under control of 
the oncologist, a video processor 54 selects portions of 
the superimposed volumetric image representation 
from the superimposed Image memory 50 and converts 
them into appropriate form and fomriat for display on a 
monitor 56 such as a video monitor, CCD display, active 
matrix, or the like. The video processor 52 may select 
slice Images, surface renderings, projection images, or 
other diagnostic imaging formats as are known In the art. 
[0021] In an altemate embodiment, the image align- 
ment system uses a calibration phantom scan. A phan- 
tom, such as one with a three-dimensional grid of fidu- 
cials, is imaged with the M Rl system The fiducial locator 
42 locates the fiduclals In the MRI image representation. 
The alignment processor compares the actual fiducial 
positions with the Imaged positions and generates cor- 
rection factors. The correction factors can be as dis- 
cussed above, vector shifts for each of a plurality of su- 
breglons, or the like. The correction factors are loaded 
into the image correction processor 48. Optionally, a 
similar correction factor determining procedure is per- 
fomried with the surface imaging system and loaded Into 
an analogous image correction processor for the sur- 
face volume image. When a patient is subsequently Im- 
aged, the MR) image representation and. optionally, the 
surface image representation, are corrected as gener- 
ated with the preloaded corrections without fiducials on 
the patient or the on-the-f ly fiducial congelation process- 
ing. 



Claims 

1. An imaging system comprising: an Imaging appa- 
ratus (A) for generating volumetric image represen- 



3 



EP 1 176 558 A2 



6 



tations of an Internal region of a subject (18) In an 
imaging region (14); a surface imaging system (B) 
for generating a three-dimensional image represen- 
tation of a surface of the subject In the Imaging re- 
gion; an image correlatingsystem (C) for correlating 
the surface and volumetric image representations; 
a superimposed volumetric image representation 
memory (52) for storing the combined, correlated 
surface and volumetric image representations; and 
a video processor (54) for withdrawing selected por- 
tions of the combined image representation, and 
converting them Into appropriate form for human- 
readable display. 

2. An Imaging system as claimed in claim 1 , further 
Including a plurality of fiducials (40) disposed in the 
Imaging region (14), the fiducials being arranged to 
be Imaged by both the imaging apparatus (A) and 
the surface imaging system (B) such that images of 
the fiducials appear in both the surface Image rep- 
resentation and the volumetric image representa- 
tion and wherein the image correlating system In- 
cludes: a fiducial locating processor (42) for deter- 
mining a location of the fiducials In each of the sur- 
face and volumetric image representations; and an 
alignment processor (44) for comparing the loca- 
tions of the fiducials detemriined by the fiducial lo- 
cating processor (42) to detennine a spatial devia- 
tion between the surface and volumetric image rep- 
resentations. 

3. An Imaging system as claimed In claim 2, further 
Including: an image connection processor (48) con- 
nected with the alignment processor to con-ect at 
least one of the volumetric and surface image rep- 
resentations In accordance with the determined de- 
viation between the Images. 

4. An Imaging system as claimed in claim 2 or claim 
3, wherein the alignment processor (44) further ac- 
cesses a reference memory (46) which stores infor- 
mation indicative of non-ilnear distortion in the at 
least one of the volumetric and surface Image rep- 
resentations and determines a non-linear image ad- 
justment In accordance therewith. 
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A method as claimed in claim 5, further including: 
prior to generating the volumetric image represen- 
tation, generating a phantom image representation 
of a phantom; comparing the phantom image with 
physical dimensions of the phantom; determining 
and storing con-ectlon factors in accordance with a 
difference between the phantom image representa- 
tion and the dimensions of the phantom; the adjust- 
ing step including adjusting the volumetric Image 
representation in accordance with the stored cor- 
rection factors. 



7. A method as claimed In claim 6, further Including: 
Identifying a plurality of characteristic points on the 

15 subject surface; identifying the characteristic points 
In the volumetric image representation and the sur- 
face image representation; and wherein the adjust- 
ing step includes: detemnlnlng a variation between 
the locations of the characteristic points In the vol- 

20 umetric Image representation and the surface im- 
age representation, and adjusting the volumetric 
Image representation in accordance with both the 
variations and the stored correction factors. 
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A method as claimed in claim 7, further including: 
affixing fiducials (40) which are identifiable in both 
the volumetric image representation and the sur- 
face image representation to the characteristic 
points on the subject surface. 

A method as claimed in claim 7 or claim 8, wherein 
the step of detemnining the variation Includes: de- 
temnlnlng an offset, a scaling factor, and a rotation 
between the locations of the characteristic points in 
the volumetric and surface image representations. 



10. Amethod of imaging as claimed In any one of claims 
5 to 9, wherein the step of generating the surface 
image representation includes one of laser scan- 
40 ning, video scanning, and ultrasonic scanning of the 
surface of the subject. 
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5. A method of Imaging comprising: generating a vol- 
umetric image representation of an internal region 
of a subject Including at least a portion of a surface 
of the subject, which volumetric image representa- so 
tlon Is distorted In a region adjacent the subject sur- 
face; generating a surface image representation of 
the surface of the subject; adjusting at least the sur- 
face region of the volumetric image representation 
in accordance with the surface image representa- 5S 
tlon; combining the surface image representation 
and the adjusted volumetric image representation. 
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